Papers with Context-faithful Expert Fine-Tuning
Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Context faithfulness is essential for reliable reasoning in context-dependent scenarios. |
| Approach: | They propose a method that identifies and fine-tunes context-faithful experts . they propose 'context-faither fine- tuning' which selectively fine- tunes them . |
| Outcome: | The proposed method identifies experts with specialization in context utilization and improves context grounding. |